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ABSTRACT 



During the summer of 1967, the Far West Laboratory for Educational 
Research and Development created a Task Force to assist in the formu- 
lation of one of its Communication Program components. The purpose 
of the Task Force was to determine and define the content and scope 
of an information system which could assist local school 
locating and using the results of research and development (R and D) 
in education. Participants focused their discussion on four areas of 
system design: 

1. Output - the information requirements of local school 

personnel 

2. Input - the content, location, and organization of information 

3. Process - existing and planned information services and 

technological developments 

4. Roles - national, regional, state, county and district 

functions in relation to an educational R and D system. 

This report presents the outcome of expert discussion and analysis 
of the above areas in answer to the following five questions; What 
is the problem? What are the existing conditions? What might consti- 
tute a model system? What are the practical possibilities? What 
system components are most needed at present? 

The major problem arises from the need of school personnel for 
improved means to obtain useful information about educational R and D. 

Effective use of R and D information under existing conditions 
requires the cooperation of many levels within the educational system. 
Initially, research and development is supported and/or performed by 
universities, foundations, and some school districts. The R and D 
results, however, are seldom in a form that can be applied directly 
in the schools; they must be summarized, interpreted, and translated 
into usable forms. These functions are imperfectly rendered by the 
curriculum specialist, who is becoming a less common feature at the 
district level while his role is becoming more important. 

At present, administrators have the largest impact upon policy 
decisions to adopt improved practices in schools, although teachers 
are striving for greater influence. 

Furthermore, the information requirements of the several groups 
participating in the change process vary,^ The present information 
network provides great masses of information. Informal subsystems 
serve researchers and administrators only moderately well. 



The proposed model information system would satisfy all reasonable 
user needs without regard to cost, technology, or manpower availability. 
Several major functions are considered: (1) collection of information; 

(2) preparation, indexing and maintenance of files; (3) interface with 
users; (4) application of information to classroom problems; and (5) 
system management. Practical alternatives for these five functions 
are also suggested. 

The following practical constraints which may prevent the ideal 
information system from achieving its potential are discussed: 
inadequate taxonomy; lack of standardization; lack of an "engineering" 
function; existing services and interests; unsophisticated user popula- 
tion; differing national and regional interests; lack of system evalua- 
tion criteria and methodology; available hardware and software; cost 
of development and operation; and legal sanctions. 

An examination of system components revealed that the present 
operations or developmental efforts of some organizations meet 
identified system requirements. The collection process is performed 
on the national level by fairly well -organized systems such as the 
Educational Resources Information Center. However, a national system 
is not appropriate for the acquisition of information on local projects 
which may have, at best, regional interest. 



Existing techniques seem to be reasonably adequate for processing, 
filing, and storage. The areas of indexing and reformulation, 
however, exhibit significant weaknesses, while the greatest break- 
down occurs at the user interface. 

In response to the needs and problems discussed in the report, 
the Task Force suggested three possible roles for the Far West 
Laboratory: (1) training and support of information specialists in 

each school district in the region; (2) preparation, production, and 
distribution of interpretive summaries on subject areas of major 

interest; and (3) preparation of an annual review of educational 
R and D. 



Educational R & D Information System Requirements - A Task Force Report 



I. INTRODUCTION 

Title IV of the Elementary and Secondary Education Act of 1965 
(Public Law 89-10) created regional educational laboratories to con- 
duct programmatic research and development so that proven innova- 
tions in education can find practical application in the nation's 
schools at the earliest possible date. The Act specifies that the 
laboratories are to identify educational problems, to conduct and 
coordinate research and research-related activities in problem areas, 
and particularly to disseminate findings for implementation in the 
schools. 

The Far West Laboratory -For Educational Research and Development 
has undertaken two major research and development (R and D) programs 
and a number of auxiliary projects. The primary R and D program, 
concerned with developing and implementing more effective inservice 
training for teachers, is presently producing a series of mini- 
courses which will employ microteaching techniques in four specific 
areas: basic teaching skills, skills for instructing nontypical 

student groups, skills required in new instructional programs, and 
skills needed for effective employment of new curricula. 

The secondary R and D program of the Laboratory seeks to improve 
dissemination and productive use of research and development infor- 
mation by school personnel who make decisions affecting school 
organization and operation. The objectives of this program are 
(1) to develop motivation among school personnel to learn about new 
developments in education, (2) to provide ef-Ficient systems through 
which school personnel can have ready access to relevant information, 
and (3) to develop organizational arrangements within school systems 
and support training programs so that school personnel will be able 
to use R and D information effectively. 

To attain these objectives, a coordinated and systematic research, 
development, and implementation effo’^t has been initiated through 
the components described below. 

Component 1: Development of Attitudes and Realistic Expectations . 

This component uses mass media to inform teachers and other school 
personnel about significant innovations and research-based develop- 
ments in education. Specific activities within this component 
include experimentation with broadcast television and film as 
means of developing motivation and knowledge; preparation and dis-^ 
tribution of written handbooks for educators; and conduct of a series 
of surveys among school personnel to determine their interest in, 
knowledge of, and attitudes toward educational innovation, research 
and development. 
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Component 2; Design of and Experimentation with Systems Through 
Which School Personnel Can Have Access to Relevant Information in 
Usable Forms . Two related activities are being undertaken in this 
component. The one which produced this report involves the collec- 
tion of data on information needs and system requirements. The other 
focuses on the development, field testing, and implementation of 
model information systems. 

Component 3: Development of Organizational Arrangements Within 

Schools to Utilize Information Effectively . This component includes 
three activities: study of educational decision making and change 

processes as they relate to information requirements; identification 
and analysis of specific organizational arrangements and training 
programs that will facilitate effective use by school personnel of 
R and D information; and pilot tests of selected arrangements and 
programs in school systems. 

As its first major task, the Laboratory has sought to define its 
particular interest in each component and to plan appropriate strat- 
egy. Five activities specifically related to Component 2 (Information 
Systems) have been initiated: (1) the Communication and Utilization 

Study for Educational Research and Development, comply '?d through 
contract with Lockheed Missiles and Space Company; (2) ohe Formulat- 
ing Educational Problems Project, conducted under contract with the 
American Institutes for Research (AIR) in an effort to develop 
systems which identify educational needs and then articulate them 
into well-defined problems; (3) a review of literature and a field 
study on how research-derived information is used by various levels 
of school personnel, conducted under contract with the Stanford 
Research Institute; (4) studies and reviews by Laboratory staff; and 
(5) a detailed study and analysis of educational information system 
requirements by a specially selected Task Force. 

The Task Force was chosen as a reasonable means to define the 
problem area in a rapid, yet comprehensive manner. After several 
weeks of planning, the Task Force first convened on 25 July 1967. 
Permanent members included Robert Coney, Chief Assistant Superintendent 
of the Alameda County Schools; Vern Plaskett, information systems 
analyst from the Lockheed Missiles and Space Company; Robert Roggen- 
buck, information systems analyst and manager of the Arizona Field 
Office, URS Corporation; and Paul Hood, research psychologist and 
program director of the Far West Laboratory for Educational Research 
and Development. Before adjourning on 30 August 1967, the Task Force 
held four working sessions on the following topics: 

1. Output - the requirements of local school personnel 

2. Input - the content, organization, and location of informa- 
tion 




3. System - existing and planned information services and 
technological developments 
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4. Roles - national, regional, state, county and district func- 
tions in relation to an educational R and D system. 

Consultants joined the permanent members of the Jask Force at 
each work session. Those attending the 

were: Virgil Blanke, School of Education, Ohio State University, 

Marvin Hockabout, Alameda Unified School District; Wayne Otto^ 

Research and Development Center for Cognitive Learning, 
of Wisconsin; and Richard Schmuck, Center for the 
Educational Administration, University of Oregon. 
participants, including elementary and high school teachers and 
principals and personnel from professional and research associations, 
state departments of education, county schools, and 1 °®®! school dis 
tricts, were invited to attend hearings on user requirements (see 

Appendix A). 

Consultants for the session on the content and oi^ganization of 
information were: Robert Gagne, School of Education, 

California, Berkeley; William Gephart, ^Qrhnni of 

Information Service, Phi Delta Kappa; and 

Education, University of Oregon. Twenty participants attended hear 
ings on this topic. 

The session on information systems had two consultants: Robert 

Hayes, School of Library Science, U.C.L.A., and Harold Borko, Systems 
Development Corporation. Three observers attended thayessi on. but 
no hearings were scheduled. At the conclusion of the session, a 
second hearing on user requirements was called to 

information. Six district coordinators, directors, or consultants in 
the areas of curriculum, instruction, or guidance attended. 

Sixteen participants attending ® final ^o-da^ conference on 
represented the U.S. Office of Education, the California State Depart 
ment of Education, the Nevada State Department of Education, the 
California Teachers Association, the California School oard Assoc - 
tion, the Contra Costa and San Mateo Supplementary Lduta..ion Centers, 
thrian Mateo County School Office, and the Far West Laboratory fo- 
Educational Research and Development. 

Agenda and lists of participants for these sessions appear in 
Appendix A. 



II. PROBLEM DEFINITION 



The main objective of the Task Force was to develop a require- 
ments specification defining the desired characteristics of an 
educational R and D information system to serve local schools 
in terms of (1) the user, (2) the input elements, and (3) the infor- 
mation services provided. Through an intent. ive, concentrated effort 
involving direct confrontation of analysts, providers, and users 
of educational R and D data, the Task Force aimed to produce a 
thorough understanding both of the elements of an information system 
and of the possible contribution of the Laboratory's Communication 
Program. 

Since it is possible to view the entire educational process in 
terms of information and communication, it is immediately necessary 
to impose limits on the system. The user population is therefore 
defined pruvisionally as school personnel at or below the county 
and district level. The concent categories are restricted to those 
types of information derived directly or indirectly from any phase 
of the research and development continuum, with special emphasis on 
applied research. These categories may also include inventions and 
innovations which have direct bearing on classroom learning. There 
are no restrictions on services, per se. 

Specifically excluded from consideration are the needs of other 
consumers of educational R and D, such as graduate students, univer- 
sity educational researchers, federal and state educational adminis- 
trators, and business and industrial producers and trainers. Simi- 
larly, information content which is concerned primarily with person- 
nel, fiscal reporting, or other types of management problems is 
excluded. 

A basic assumption of such an information system is that the 
improvement of American education does not depend only upon systema- 
tic investigation of the educational process, the necessary condi- 
tions fo\ Iri ^ ing, and the consequent development of strategies, 
technology, ' materials. It also requires awareness of , rational 
choice among , and successful adoption and implementation of instruc- 
tional strategies, educational technology, and materials in the schools. 
Among a number of problems which any educational change practitioner 
must consider is that of creating an awareness of and providing 
information about alternatives.^ Although the Task Force at times 
questioned the validity of the basic assumption, it did accept as a 
starting point the premise that something could be done to improve 
the present conditions and means whereby operating and planning 
school district personnel can obtain relevant educational R and D 



^See for example. Planning and Effecting Needed Change in Education , 
edited by E. L. Morphet and C. 0. Ryan, N.Y., Citation Press, 1967. 
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information. Basic questions such as the following were posed: 

1. What are the existing conditions? 

2. What might be a model system? 

3. What are the practical possibilities? 

4. What is most needed? 
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III. DESCRIPTION OF EXISTING CONDITIONS 

This section describes present conditions in public elementary 
and secondary education which impinge upon the adoption of improved 
instructional practices. Excluded from this discussion are those 
operations which are restricted to the maintenance of on-going activi- 
ties or whose primary purpose is non-innovative, but make some 
peripheral contribution to implementing improved practice. 

A. Organization of Public Education 

All authority exercised by agencies and individuals in the 
public schools has its origin in state legislatures. State depart- 
ments of education, county school departments, and local districts 
are agents of the legislature, each assigned specific responsibil- 
ities in support of the state educational enterprises. 

In order for these enterprises to operate efficiently, three 
broad functions must be carried out: policy determination, coordina- 

tion, and operation. Chart 3.1 shows the distribution of these 
functions among the three levels of the California educational sys- 
tem. This distribution may be considered typical of many states. 

Policy determination and operation are commonly understood 
termsT Coordination involves providi ng advice and assistance to 
district personnel above the level of teachers (i.e., administrators, 
curriculum specialists, and school board members) for the purpose 
of improving the district's instructional programs. Coordination 
may be considered a "quality control" function which, if success- 
ful, provides continuous improvement in the product on the 
operatic: level. In general, coordination consists of two tasks: 

(1) equalizing educational opportunity across the state by 
focusing special assistance on small, poor or otherwise laggard 
school districts in order to bring their instructional program 
closer to the state average, and (2) encouraging and assisting the 
total state system of public education to continuously evaluate 
and adopt instructional improvements. 

The decision to modify instruction, however, rests with the 
legislature and the districts. Coordinating agencies (state 
department of education and county school departments) cannot im- 
pose instructional improvements, but can work to encourage and 
facilitate the adoption of such improvements. Thus, state agencies 
and county school departments employ subject level or area special- 
ists who provide information to district personnel. The state or 
county curriculum specialist may not always supply this information 
personally, but he may provide a ifiiechanism (workshops, curriculum 
committees, etc.) through which district personnel can acquire 
information. The decision to adopt a change, as well as the 
adaptation of information and its transmission to teachers and other 
district personnel, is the responsibility of the district board, 
administrators, and district curriculum specialists. Direct 
contact between county and state curriculum specialists and 



CHART 3.1 



7 



DISTRIBUTION OF BROAD INSTRUCTIONAL FUNCTIONS 
AMONG LEVELS OF CALIFORNIA STATE 
SYSTEM OF PUBLIC INSTRUCTION 



FUNCTION POLICY COORDINATION OPERATION 



LEVEL 

State Legislature 


Plenary; subject 
only to constitu- 
tional restriction. 


None. 


None. 


State Department 
(State Board) of 
Educati on 


Limited (e.g., 
elementary text- 
book selection). 


Responsibility for 
promoting equal 
educational opportu- 
nity and improvement 
of instruction in 
school districts 
across state. 


Severely limited 
(e.g. , State 
School for the 
Blind). 


County School 
Departments 


None. 


Responsibility for 
promoting equal edt^ 
ucational opportun- 
ity and improvement 
of instruction in 
school districts of 
the county. 


May operate special 
schools and classes 
(e.g., physically 
handicapped, wards 
of juvenile court). 


School Districts 


Limited to some 
operati onal 
activities. 


None. 


Primary responsi- 
bility for operating 
all schools and 
classes. 
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teachers is usually limited to those occasions when a teacher has been 
appointed to serve as the district's curriculum representative to some 
coordination activity. 

The quality of the coordination service varies widely among 
counties and districts. Since no district is required to accept the 
service and since there are few standards for determining its scope, 
many districts receive little or no useful information about 
instructional innovations from county or state departments of educa- 
tion. 

The distribution of functions among the levels of the state educa- 
tional system means that a school district's decision to adopt an 
improved instructional practice may require the approval (policy deci- 
sion) of the state legislature and may be affected, to some degree, by 
support from county school departments and/or the state department of 
education. 

The nature of public education also affects the introduction of 
instructional improvement. Authority, as well as resources, for a 
district to make a change may exist; the county school department and 
state department of education may support and encourage the change; 
but unless the community approves, no change will occur. 

Several recent trends which affect the introduction of instruc- 
tional innovation should be noted. 

1 . Legislative Mandates 

Recent years have brought a shift in the nature of policy 
decisions made by state legislatures. Where once such decisions 
were largely restrictive ("Thou shalt not. . . .") or inclined to 
set general minimum standards of operation, recent legislative 
policy decisions have mandated, or encouraged through special 
funding, the introduction of specific content and methods of 
instruction. This has the effect of forcing innovation at the 
operating level. Most observers agree that this activity will 
continue to increase. 

It is doubtful, however, that these mandates create conditions 
for meaningful improvement of instruction. Vihere a local community 
and school district professional staff are opposed to the legis- 
lative mandate, pro forma compliance has resulted without sub- 
stantial effect upon what pupils learn. On the other hand, where a 
community and staff have been committed to an instructional improve- 
ment, it has been introduced prior to, or often in spite of, legis- 
lative action. 

2. Teacher Organizations 



Recent legislative enactments in several states have given 
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teachers' organizations the authority to negotiate ("meet and con- 
fer") directly with district governing boards on matters involving 
instructional improvements. This, some observers feel, will insert 
a significant element into the decision-making process. It is 
argued that teachers will be able to bypass the administrative and 
supervisory "gate-keepers" and deal directly with the policy makers 
(governing boards). Experience to date, however, does not support 
this belief. Negotiations between teacher groups and governing 
boards have been almost exclusively concerned with topics which, 
although they may include some element of instructional improvement, 
are primarily concerned with teacher welfare — salaries, work load, 
nonwage benefits, personnel policies, etc. No examples have been 
reported of teacher groups negotiating with governing boards to 
adopt instructional Improvements that would result, for example, 
in increased work nr additional study or retraining for 
teachers. 

On the other hand, there have always been individual teacher 
and group efforts to develop new instructional improvements. Where 
such improvements required a policy decision for implementation, 
they have met the same constraints which proposals from any other 
person or group have met. Where such innovations required teacher 
organization support, the support has generally been withheld 
unless the element of teacher welfare was present. 

During the next decade, the role of professional organizations 
will probably continue to be one of supplying teachers with welfare- 
oriented information and services and of lobbying for teacher wel- 
fare measures at the policy decision level. Direct organizational 
involvement in decisions affecting instructional innovation at the 
district level seems unlikely. 

3. Federal Government - U. S. Office of Education 



With the advent of the National Defense Education Act, the Ele- 
mentary and Secondary Education Act, the Vocational Education Act, 
and others, the impact of the federal government upon instructional 
practices has increased dramatically. The availability of sub- 
stantial amounts of federal money for districts which meet criteria 
established by Congress and the U. S. Office of Education has 
led to federal direction of an increasing, but still small, por- 
tion of the nation's educational effort. The trend seems to be 
toward greater federal involvement in instructional improvement. 

Organization of Education - Summary 

Public education is characterized by a diffusion of decision- 
making authority. At the operational level, such authority is 
shared by the local district and the state legislature. Infonna- 
tion and assistance on decision making and policy implementation 
are provided by county school departments and state departments 
of education. Unfavorable public and professional attitudes 
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toward proposed changes, particularly at the district level, can 
impose an important constraint upon acceptance of innovation. 

Mandates from state legislatures and opportunities for obtain- 
ing additional state and federal funds to support specific 
instructional practices are also having a greater impact upon the 
operational level. 



The effects on instructional practice of innovations initiated 
by teachers and teacher associations will remain at about current 
levels. Professional associations will continue to provide infor- 
mation exchange and lobbying services for their memberships on 
matters affecting teacher welfare. 



B. Improvement in Instructional Practice 

As used here, instructional improvement and innovation mean 
those changes at the operating level (district, school, or class- 
room) which require the approval of, or contact with, another agent 
or level. We do not include here those decisions which the teacher 
makes in his day-to-day teaching. Although vital to the quality of 
instruction, such decisions are routine. Our concern is with those 
decisions which are non-routine and require the institution of new 
practices and procedures. 

Listed below in Chart 3.2 are the general conditions which must 
exist for instructional improvement to take place. 

CHART 3.2 

Conditions Required for Instructional Improvement 



Condition 

a. Perception of l!eed 
to Change 

b. Opportunity (Approval) 



Description 

Problem has been identified; indi- 
vidual or group has requested or 
demanded improvement; change is 
required 

Policy level (approval agencies) 
will permit change 



c. Solution Known 



Probable method of improvement is 
(or alternatives are) identified 



d. Resources 



Time, staff, space, materials and 
funds are available to support 
initiation and maintenance. 



Each of these conditions creates unique information require- 
ments for the system: 




1. Perception of Need to Change 



Are the district's goals realistic? 

How do these goals compare to goals of other districts? 

What evaluative instruments are available? 

To what degree is the district meeting its goals? 

How well are other districts meeting their goals? 

Are there new processes, techniques and materials being 
adopted elsewhere which might affect these goals? 

2. Opportunity (Approval) to Change 

What are the legal restrictions, if any? 

What is the attitude of the school board and community? 

What similar changes have taken place elsewhere and with 
what results? 

3. $olution(s) Known 

What research has been conducted in this problem area and 
with what results? 

What development has taken place? 

Which districts have applied solutions? 

What were the results? 

How unique is our problem? 

Can experience in other districts be adapted to our situation? 

4. Resources 

What does the proposed solution cost to initiate and maintain? 
What are the space, staff, material, training requirements, etc? 
What resources can be made available? 

What additional resources can be obtained? 
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Improvement in Instructional Practice - Summai^ 



Improving instruction requires that the operating level (teacher, 
school, or district) make some outside contact for the purpose of 
obtaining information. This information is required (1) to help 
operating personnel perceive the need to change, (2) to encourage 
policy groups to grant approval, (3) to describe alternative solu- 
tions, and (4) to define the resources required to implement the 
instructional innovation. 



C. Types of Information 

The operating level in the public education system receives 
various types of information on solutions to problems. Chart o.d 
describes those which are presently available. 



General Information is often unsolicited. It pours into the ^ 
operating level in varying formats from widely diverse sources, and 
is rarely complete or easily used. It does, however, serve an 
important stimulatory function. In a general, diffuse way, practir 
ti oners are kept informed of "what's new," of problems faced by other 
practitioners, of solutions applied, of new developments, and of the 
successes and failures of their peers. When this information is 
received, the practitioner relates it to his personal si tuation and 
begins to ask such questic-.s as: "Am I meeting my goals? ; Could 

this do something for me?"; "Could this happen to me. , etc. This 
process often stimulates a search for other types of information. 

The other types of information classified in Chart 3.3 require 
that the practitioner initiate a request. The particular type 
requested is determined by these factors: the user s position, his 

knowledge of the field in which he is making an inquiry, and the 
degree to which he is committed to implementing a probable solution. 
In each case, the user has a "need to change" and is seeking a 
solution. 



Focus ed Information is best described as an initial search through 
all the information. avail able. The practitioner has identified his 
problem area, but is largely unaware of the range of information or 
the sources available to him. His inquiry is in the nature of: Tell 

me what's new in ?" or "What are other people doing about 

?" or "Who has done something recently about - > ‘ ^ 

type of information rarely results in action. It is neither specific 
nor usually detailed enough to guide an adequate response. It is 
useful, however, as a survey device to narrow the field for further 

inquiry. 



Information systems such as the Educational Resources Information 
Center (ERIC), and the School Research Information Service [SRIS), pro- 
fessional education libraries, the Education Index, Clearinghouse 
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Reports, listings of abstracts, and the like are all sources of 
focused information. 

Specific Information is requested when the inquirer has an Inltidl 
knowledge of the field or when a previous request to a focused infor- 
mation source has helped to narrow his field of inquiry. 

The request for specific information may be expressed in the form 

of "Get me everything on or "I want a copy of that - udy 

by The seeker of such information has progressed toward a 

general solution. He is attempting to narrow the solution area and to 
make some judgments about the relevance, the opportunity for approval, 
and the costs of instituting a solution in his district. 

Interpreted Information emerges when all relevant information on a 
particular area has been collected, evaluated, and interpreted. This 
type of information must be available before a valid solution can be 
designed. 

At the present time, little evaluated and interpreted information 
is available. Users who are committed to innovation usually turn to a 
consultant for advice. The consultant may be a college or university 
faculty member, a practitioner in another district which has recently 
adopted the same or a similar innovation, or a curriculum specialist 
from the district office, county school department, or state depart- 
ment of education. 

D. Derivation of Information 

Information about innovative instructional practice usually is 
derived from formal research and development and innovative operations. 

R and D Activities, usually conducted by members of college and 
universi-5^ staffs, have as their primary purpose the evaluation of a 
process or practice not generally accepted as proven. 

Information about these activities may become available at any one 
of several stages, described by Robert Gagne as: 

Initial Plan 

Proposal 

Program Plan 

Progress Report 

Research Report 

Abstract 
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Evaluative Report 
Interpretive Summary 



Handbook. 

The information available at any given stage is helpful to only 
a narrow segment of users. At the present time, information systems 
provide general, focused, and specific information about all staaes 
of research and development, but in varying degrees of responsiveness 
to the immediate need of the user. Many researchers believe that ^ 
information on research activities should not be made generally avail- 
able to users before the Abstract (or Evaluative Report) stage. They 
argue that, prior to this stage, information is tentative and directed 
to answering the research problem; its results cannot be applied to 
instructional operations. Information about early stages of research, 
they point out, is of real use only to other resec*, chers. 

Users, on the other hand, express keen interest in finding out 
what is on-going in research and complain that little current informa- 
tion is available. (Their complaint may be a result of a lack or inter- 
pretive summaries. It may also indicate that available summaries are 
inadequate, since users complain that too much of the research is not 
"useful" or is "in the wrong format.") 

Innovative Operations, as applied here, refer to those activities 
at the operation level which are new to some or many practitioners, but 
which are not designed primarily to provide or test new knowledge. 

These operations are on -going instructional activities, instituted to 
solve a particular problem. They may either be based upon or adapted 
from research findings or other innovative practices or have a com- 
pletely subjective justification. Innovative operations are often 
evaluated objectively, but usually with far less rigor than R and D 
activities. 

Although general, focused, and specific information about innova- 
tive operations is available, district personnel generally think that 
it is not easily acquired. Useful information about known innovative 
practices often seems difficult to obtain. Users also feel that ^hey 
know nothing about other available information on innovations. 

Originators of information, then, ere the researchers, who develop 
and test new knowledge about instructional practice, and the practi- 
tioners, who operate innovatively. Information about their activities 
is not adequately conveyed to users. 

E. Users of Information 

Users of information are those persons at the operating level who 
require information in order to institute instructional innovation. 

Not included in this definition, for example, is the researcher who 
requires information to perform his research function. 
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It is not possible to designate information users by job title 
because of wide variation in school district size and staffing patterns, 
non- uniformity in job titles, and differing degrees of emphasis dis- 
tricts give to instructional innovation. Four distinct functions are, 
however, visible in every school district. These may be performed by 
persons having various job titles. Often, one person may be involved 
in more than one of these four functions: 

1. Teaching 

2. Curriculum Development 

3. Administration 

4. Policy Determination. 

Chart 3.4 lists the more common job titles in the education pro- 
fession and indicates the range of titles that are most often assigned 
to persons who perform the functions listed above. 

The teaching function is, of course, performed primarily by teachers; 
but department heads, vice-principals, principals, and coordinators may 
teach one or more classes. Teachers, on the other hand, may have spe- 
cified administrative and curriculum development tasks. 

rhe curriculum development function covers the broadest range of 
job titles. Persons performing this function interpret and adapt inno- 
vations to meet local needs and are potentially heavy users of the 
information system. Curriculum development is the primary responsibility 
of the coordinators/consultants/supervisors who are concerned with 
instructional improvement. An axiom in education states, however, that 
"curriculum development is everybody's job." 

The administrative function includes two roles — school and district 
admi ni strati on— whi ch are melded in practice through various internal 
management devices, such as administrative cabinets, etc. In some dis- 
tricts, the coordinator/consultant/supervisor group may perform adminis- 
trative duties, although this is generally regarded as poor practice. 
Directors and/or assistant superintendents link the curriculum develop- 
ment and the administrative functions. 

Policy determination is the responsibility of the district governing 
board and the state legislature. At the present time, the administrative 
group has the largest impact upon the policy makers, although recent 
legislation proposes to give teachers and curriculum specialists a more 
immediate and greater Impact upon local governing board policy decisions. 
Policies are, of course, effected by personnel assigned to other func- 
tions. 

Each function plays a part in instructional innovation and has 
unique information demands. Curriculum development utilizes information 
on the process of the innovations and their personnel needs. In general. 
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Chart 3.4 



DISTRIBUTION OF DISTRICT JOB TITLES BY FUNCTION 
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teaching requires that information on innovations be processed and then 
adapted to classroom tasks. Administration demands information rele- 
vant to the resource and management requirements of innovations and to 
their effect unon teachers and policy groups. Policy determination 
requires information which interprets resource needs and results in 
broad terms. Policy groups are concerned far less with the pro- 
cedures for instituting innovations than are persons performing other 
functions. 

F. Sources of Information 

The number of sources of information on innovative instructional 
practices cannot even be estimated at the present time. Information 
now flows into the system from a wide variety of sources, and thus 
differs in degree of completeness, accuracy, credibility, validity 
and in processing requirements. The information input generally 
takes two forms: (1) individual items or documents and (2) human 

memory and verbalization. 

Several categories of subsystems operate upon the original infor- 
mation to make the input more usable. 

Indices. Indexed lists of educational information are available, 
such as the Education Index and bibliographic indices published by 
government agencies, professional associations and commercial groups. 
Common complaints about such indices are the inadequacy of subject 
heading or other categorization schemes, the lack of descriptive 
material and the time lag in production. 

Libraries . Professional libraries, usually district or county 
curriculum and university libraries, are generally available to most 
individuals. The users of this subsystem complain, however, that the 
collections are incomplete and not designed for effective use. The 
collections in most libraries are built and organized on the basis of 
specific user requests rather than on an assessment of needs and antici 
pation of requests for topics of immediate or growing interest. In 
addition, libraries are not organized primarily to collect R and D 
information. (Although librarians would like to do this, they state 
that the resources ar& not available to them.) 

Information Services. Several information services, national or 
local in scope, either are being planned or have begun operations. 

The Educational Resources Information Center (ERIC) and the School 
Research Information Service (SRIS) of Phi Delta Kappa are examples. 
These services will provide focused and specific information upon 
request in the form of either bibliographic lists of stored data or 
complete documents. 

ERIC, a national information service managed by the U. S. Office 
of Education, has established eighteen clearinghouses, each assigned 
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to a particular field or subject. At some future date, the clearing- 
houses plan to prepare resumes in special areas. 

SRIS proposes to serve school districts by collecting, indexing, 
and storing for retrieval reports of innovative practices in public 
schools. Hopefully, the ERIC data file will be cross-indexed to the 
SRIS file. 

Problems have been encountered by users of these information ser- 
vices for the following reasons: 

1. Small size of data base (e.g., in August, 1967, ERIC had only 

about 2,50C documents available) 

2. Differences in methods of collecting information 

3. Lack of critical evaluation of input material 

4. Lack of systematic feedback from user on the value of the 

information and/or services. 

5. Lack of interpretive or evaluative summaries 

6. Lack of personalized service, i.e., there is no dialogue with 

the user to help him define or refine his problem. 

Personal Interaction . The most commonly used and, presently, the 
most valuable information service, is the interaction of people at 
conferences, workshops or meetings of various kinds, and on-the-job 
discussions. This is a highly subjective subsystem, but one which 
users report yields high credibility. 

Personal interaction, however, tends to develop and reinforce a 
narrow "closed loop" information system which insulates the user from 
much of the available relevant information. Its information capacity 
is, of course, limited. 

Organizations . Professional organizations, government agencies, 
and other formalized groups (including private industry) provide infor- 
mation services in the normal course of their operations. Nearly all 
groups publish some type of document, ranging from newsletters or 
journals to reports of conference proceedings, which may be accessible; 
however, the value of the content, in terms of the validity and timeli- 
ness of the reports, is often questioned. 

Users point out that much R and D information relevant to instruc- 
tional innovation appears in documents produced by associations related 
to other disciplines, such as psychology, sociology, medicine, and 
anthropology. This material, and similarly, information generated by 
private industry, is not readily available to the educator. 
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6. Content of Information 

Research and development in education occurs in the following con- 
ventional subject areas: 

1. Definition of Objectives 

2. Curriculum 

3. Instructional Methods 

4. Guidance and Counseling 

5. Teacher Training 

6. Assessment of Student Capability 

7. Assessment of Student Performance 

8. School Administration 

9. School Financing. 

Since these areas are related to and derived from the purposes 
rather than the methods of education, research findings must apply 
not to day-to-day operations, but to periodic decisions for change 
that are made when new objectives are established or when the existing 
operations fail to achieve established objectives. 

H. Developments 

The following developments can be expected to exert an effect up.n 
the operation of any infoi^matlon system serving instructional innovation: 

1 . National Information Service 

Present plans for the development of ERIC should result in its 
emergence as the primary national service producing educational 
research and development information. No other proposed or develop- 
ing national service has comparable organizational support, finan- 
cial resources, or access to R and D information. 

The information content of ERIC will include abstracts and 
reports of federally sponsored R and D projects from the funded pro- 
posal through final report stages, as well as abstracts and reports 
of R and D activity supported by major foundations. Cross-indexing 
to other national information services hopefully will be available. 

The number of ERIC clearinghouses will probably expand from the 
present eighteen to twenty or more. These clearinghouses will pre- 
pare summaries of relevant research by subject or area of interest 
and will distribute them through ERIC, Although ERIC will not 
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include journal literature and will not provide interpretive and 
evaluative reports of R and D, the service may contain bibliographic 
lists Of Such documents maintained in other information service 
files. ERIC may also contain bibliographies of curriculum materials, 
such as manuals and handbooks, maintained in other collections. 

2. State Information Services 

Both the California and Nevada State Departments of Education 
now recognize the need to improve the dissemination, of informa- 
tion on instructional innovation. Such recognition should result 
in the establishment of more formalized state-wide information 
services, probably in the ERIC format. The information content 
of these state services, however, will emphasize instructional 
materials (guides, manuals, handbooks) developed by state and 
local educational agencies. Bibliographies of these collections 
may appear in ERIC. 

Specialized state-wide information systems serving narrow _ 
bands of users, such as special education personnel, vocational 
educators, or PACE Center personnel, will probably become more 
formalized as public education becomes more specialized. Cross- 
indexing of these specialized services to a general, state-wide 
service will be a continuing problem. 

3. Role of School Personnel 



The roles of personnel at the operating level continue to 
change in response to changing conditions both in the profession 
and in society. 

Teachers are currently seeking a greater role in the process 
of instructional decision making. While we believe that teacher 
organizations will not assume a major role in decision making with- 
in the next ten years, the number of teachers seeking to effect 
instructional policy and possessing the expertise to do so will 
continue to increase. This number, however, will probably remain 
a small portion of the total teaching force. 

School principals, it seems clear, are now largely uninvolved 
in the instructional^innovation process. They will probably move 
further into the administrative/management areas and, as schools 
grow larger and become more specialized, will become less and less 
instructional leaders. 

Curriculum specialists will probably be much less concerned 
with locally initiated innovation and supervision (i.e., evaluation 
of individual teachers) and m.ore involved in the local adaptation 
of major curriculum innovations originating elsewhere. 

The presence of the curriculum specialist in local districts is 
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becoming less common as school districts grow and reorganize. This 
reflects, in part, the greater demand for administrative roles in 
larger districts and, in part, the allocation of greater proportions 
of district budgets to teacher salaries and other benefits. 

The reduction in the number of curriculum specialists at the 
district level is occurring at a time when there is an increased 
demand for interpreting and evaluating instructional innovation— 
a task which such specialists are uniquely qualified to perform. 

This situation may well place greater demands upon state and 
county curriculum specialists. (The California Teachers Associa- 
tion proposes to make consultant services available to local 
teachers' associations to help them develop and implement instruc- 
tional improvements. This proposal may portend the employment of 
curriculum specialists by teacher organizations rather than dis- 
tricts. In any case, it supports the need for the curriculum 
specialist. ) 

4. Private Industry 



We may expect to find increasing development of "instruc- 
tional packages" prepared by private industry for sale to the 
schools. These packages will probably provide information on 
subject matter and recommended methods or procedures and include 
instructional materials and equipment. 

I. Summary 

Effectively implementing innovation in today's elementary and 
secondary schools requires the cooperation of many levels within the 
educational system. Initially, research and development is supported 
and/or performed by universities, foundations and some school districts. 
The R and D results, however, are seldom in a form that can be applied, 
directly in the schools; they must be summarized, interpreted, and 
translated into usable forms. Assistance in adapting research results 
to the teaching function, however, is imperfectly rendered by curriculum 
specialists at the district, county and state levels. Furthermore, the 
curriculum specialist is becoming a less common feature in the local 
school district, while his function is becoming more important. 

In the schools, the decision to adopt improved practices depends 
upon the perception of the need for change by teachers, administrators, 
and approving agencies (local governing board and/or state legislature). 
The approval of change is often conditioned by the availability of 
resources over which the operating agency may have little control. At 
the present time the administrative group has the largest influence 
upon policy decisions, although teachers are striving for a greater 
impact upon local governing board decision making. 

The information requirements of the several groups participating 
in the change process vary. The present information network serving 
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Dublic education provides great masses of information to all partici- 
pants. Present subsystems, many of an informal nature, serve researchers 
and administrators moderately well. The new subsystems and services 
planned or just beginning will improve information not only for re- 
searchers and administrators, but also for curriculum specialists. 

The most serious failing of the present information system, how- 
ever, is the almost total absence of interpreted and evaluated infor- 
mation available and useful to classroom teachers. 
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IV. MODEL SYSTEM REQUIREMENTS 
A. Introduction 



The following description of a theoretical system for dis- 
seminating information on improved classroom teaching is intended 
to represent an idealized situation in which all reasonable needs 
of the users are satisfied without regard to cost, technology or 
manpower availability. The theoretical system is presented in 
terms of the functions required of the various system components. 

In a subsequent section of this report, various alternative 
systems, more feasible in terms of present-day constraints, will 
also be described in terms of functions. A comparison may thus be 
made of the "possible" with the "desirable" on the basis of func- 
tion alone. This analysis and comparison by function is intended 
to avoid as much as possible any bias toward a particular type of 
available hardware or present mode of operation of an information 
system. 

"Information system" or "system," as used in this report, 
refers to the complex of all functions involved in the process of 
collecting, developing and producing in final form information on 
innovations in elementary and secondary education. The term also 
covers dissemination of this information and its application to 
classroom situations. 

As defined above, a system need not, of course, have all its 
component parts or functions co-located to operate properly. It 
is assumed in this case that many parts of this system will be dis- 
persed. The research activities on which the system will depend 
for a large part of its information may be performed in many dif- 
ferent locations. The information files themselves may or may not 
exist as a single grouped entity. They may be stored in one large 
central area or in several separate regional or topical files from 
which their purpose could be served equally well. 

B. Functional Description 

A functional block diagram of the theoretical system is pre- 
sented in Chart 4.1. The various detailed functions depicted in 
this figure can be grouped into the following major classes. 

1, Collection of Information 



Tangible information on’ instructional methods exists 
largely as formal and informal reports, theses and disserta- 
tions, and journal articles. These describe, with varying 
degrees of quality, the bases, methods, and results of research 
and, in some cases, relate experience in application to class- 
room situations. At the present time? this information resides 
in a number of different places: the libraries of colleges and 

universities; collections of various local, state, and federal 
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government agencies; transactions and journals of professional 
societies; records of professional meetings; and personal 
collections of educators and others. 

The function of collecting information for inclusion in a 
system has three sub-functions: (a) location of information, 

(b) evaluation in terms of pertinence and suitability, and 

(c) acquisition for use. 

a. Location of information requires knowledge of and 
access to a large number of sources which may be widely 
dispersed, since education touches on various other 
disciplines, particularly the social/psychological fields. 
The following are typical of possible sources: 

(1) Reference materials in general and specialized 
1 i brari es 

(2) Prepared abstracts in specialized fields 

(3) Special-purpose indices ( Education Index , for 
example) 

(4) Indices and resources of professional societies 

(5) Contacts with individual workers in the required 
field of specialization 

(6) Preliminary information on research work in pro- 
cess (progress reports, for example) 

(7) Proceedings from professional society and special- 
purpose meetings 

(8) Journals and other publications of professional 
organizations 

(9) Indices of government-sponsored projects 

(10) Sources of statistical data— government and other. 

A continuing effort to develop knowledge of the avail- 
ability of such sources, as well as thorough familiarity 
with their content, credibility, and methods of use, is 
essential to the sub-f unction of information location. 

b. Operating an information system requires a continuing 
effort to prevent trivial and non-pertinent information 
from entering the system. People experienced in using 
present sources generally agree that much of the readily 
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available information is either unsuitable to their 
needs, too poorly documented to be of any use, or un- 
acceptable because research work was not performed care- 
fully or thoroughly enough. Because of the volume of 
research and other material being generated, as well as 
the need for school personnel to receive requested material 
in usable form, a screening function must be included in 
the collection process. 

Within the theoretical system, a "development" group, 
composed of experts in the particular area of information 
being considered, would study the quality and pertinence 
of material proposed for inclusion in the system files. 

They would use standards for documentation and research 
methods established with the concurrence of appropriate 
members of the professional community. The "development" 
group would thus perform a function similar to one now per- 
formed by editorial committees in accepting papers for pre- 
sentation at conferences or publication in journals. For 
example, a research report on a topic of interest to class- 
room teachers or curriculum coordinators might be accepted 
by the group only if it meets the standards on experiment 
design and validation and includes a clear abstract and 
interpretive summary. The value of the work would then 
be apparent. 

c. After a document has been determined suitable for 
inclusion in the system, its acquisition begins. For the 
most part, acquisition is a mechanical process whose form 
will depend greatly on the form taken by the system files. 

If all the system documents are to be stored in a cen- 
tral file, then acquisition means obtaining one or more 
complete copies of the document. In this case, since the 
fundamental reason for placing a document in the file is 
to facilitate its duplication and dissemination, the copy- 
right status and terms of each acquired document must be 
clearly understood and observed. 

If the central file consists only of references to 
sources of information, then acquisition becomes the sim- 
pler process of adding a record to the files with appro- 
priate source information and a suitable description. In 
such a case, there would probably be no need for concern 
over copyrights at the time data entered the system. 

2. Preparation, Indexing and Maintenance of Files 

A primary purpose of the system is to acquaint teachers 
with material which they can then apply to their work. To 
satisfy their need, the system should contain short, printed 
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abstracts of each document suitable for quick review. Signifi- 
cant differences in background, training, and interests between 
teachers and researchers, however, will cause difficulty for 
the teachers in fully understanding and properly applying many 
of the reports. An interpretive function is therefore clearly 
needed. Interpretation and synthesis could probably be com- 
bined whenever a large amount of information exists for a topic 
area. In this case, the teacher's need would more likely be 
for an overview or synopsis of what has been done by several 
researchers, rather than for an explanation of what has been 
done by one or two. 

The abstracting and interpretive functions could be per- 
formed by the "development" group if they are to be considered 
the "engineers" of the system. In other words, they would 
assume the role of intermediary between pure research and 
application, functioning similarly to engineers who serve the 
economic community. 

The existing communication gap between researchers and 
teachers could also b? narrowed by making researchers aware 
of the need for effective communication with the users of their 
product. A system of rewards could be developed for success- 
ful communication. 

The need for indexing the collection requires no explana- 
tion. This system would probably use several other sources 
as part of its files. If at all possible, therefore, common 
indexing procedures should be developed. 

File maintenance would include mechanical upkeep of the 
materials, replenishment of stock, and supervision of usage 
and other records. 

3. Interface with Users of Information 

The users of the information system are those people 
concerned in any way with decisions to introduce innovations 
in educational methods. In general, people at or close to 
the teaching level can be expected to have the greatest need 
for material provided by the system. For certain purposes, 
however, particularly advisory and informational, school per- 
sonnel at all levels will make demands upon the system. Under 
some conditions, even lay groups such as school boards and 
parents' organizations may find the information in the files 
valuable. 

The interface function encompasses all actions needed 
to furnish a satisfactory response to a request for infor- 
mation. Normally, the user group will submit rather general. 
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poorly defined requests which cannot be used to pinpoint 
specific information in the files. A very important part of 
the interface function, and one which will heavily affect user 
acceptance of the system, is assistance in problem definition 
and explanation of general system capabilities. This service 
will enable users to learn how to communicate with the system 
and take full advantage of the accessible sources of information. 

In an ideal situation, the user would be able to establish 
a quasi -personal relationship with the system so that response 
to his questions would be attuned to the role he identifies 
for himself in requesting information. The system itself 
would be designed to furnish responses and to ask pertinent 
questions on either a "check-list" basis or on a more sophis- 
ticated level. This procedure would (1) establish specific 
information needs; (2) offer alternative search strategies if 
required; (3) confirm, when it becomes apparent, that a request 
cannot be filled; (4) in the case of successful searches, 
provide an estimate of the volume and the cost of furnishing 
the requested data; and (5) offer an opportunity for the 
requester to specify the format of the data to be supplied. 

The availability of various output formats for the latter pur- 
pose would permit the user to make a selection according to 
his interests. The design philosophy of the interface, then, 
is to provide an automated equivalent of an intelligent and 
helpful librarian who is well acquainted with the available 
information, alternative sources, and typical needs of differ- 
ent user classes. 

An individual could pose his questions to the system by 
typing them on some kind of keyboard. The system would then 
respond as to data availability, cost, search strategies, 
formats, etc., by means of a cathode ray tube (CRT) display or 
a teleprinter. The device should be capable of displaying an 
abstract of any document on file in the system within a reason- 
able console-operation time, up to one minute. Ideally, a 
hard copy of a complete document would be printed at the user's 
terminal within ten minutes after his request has been entered. 

Another vital sub-funcrion performed at interface is feed- 
back of information on usage volume, types of information 
required, profiles of the user population, user acceptance, 
and other indicators of system performance. The System Manage- 
ment function, described later, will use this information in 
the continuing improvement of system operation. 

The interface funct'on includes all input/output sub- 
functions concerned with dissemination of the information in 
the system files. Included are such activities as providing 
hard copies of file documents, furnishing descriptive material 
and training programs on system usage, maintaining personal 
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liaison to handle special questions outside the scope of the 
automated facilities, and handling other problems encountered 
in use of the system. 

4. Application of Information to Classroom Problems 

The end use of the information on innovative practices— 
its practical application to improving effectiveness of class- 
room teaching--is the most important part of the entire system. 
Curriculum specialists, personnel concerned with specifics on 
potential improvements, and individual teachers who desire 
access to the system comprise the bulk of the "customers." 

Unless they are able to use- system facilities to learn of 
improvements in the teaching arts and to select and apply 
them knowledgeably, the system will rapidly become useless. 
Because it is important that this user group accept the sys- 
tem, both system management and interested educators must 
direct continuing attention to all activities which will en- 
sure a healthy level of participation. Although other activi- 
ties will undoubtedly become evident to these personnel with 
additional experience, some initial possibilities are suggested: 

a. Preparation and release (to news media, professional 
organizations, and others) of "public relations" material 
which describes the purpose and scope of the system and, 
wherever possible, gives specific examples of its effec- 
tiveness. 

b. Conduct of workshops, institutes, and other informa- 
tional sessions to acquaint potential users with the pur- 
poses of the system and it's value to their work, as well 
as to train them in its use. 

c. Demonstration of the system, to emphasize the value 
of knowing about on-going educational improvements, for 
lay groups which exert strong influence on education 
policies. Directed particularly to school boards, par- 
ents' organizations, civic associations, etc., this 
activity should be exercised with extreme care in order 
to show benefits which will clearly accrue to members of 
these groups. 

d. Continuing appraisal of the system with the aid of 
advice from users on its effectiveness. 

5. System Management 

Although this function is shown as one block in Figure 1, 
it is not necessary that a single individual or small group 
perform the total management or control function. In fact, 
some sub-functions are performed more effectively by various 



31 



independent individuals who might be called system "contri- 
butors," rather than "managers." The following are types of 
management sub-functions which apply to the theoretical system: 

a. Control of system configuration 

b. Supervision of user interface activities 

c. Coordination of development activities 

d. Review of data file status, condition, volume, etc. 

e. Review of indexing and abstracting procedures 

f. Advice to research organizations on topics for needed 
research 

g. Coordination with users on needs and system effective- 
ness 



h. Staffing and training 

i. Advice on staffing to coordinating groups 

j. Coordination with school system personnel who 
determine instructional policies under which the users 

of the information system perform their teaching function 

k. Maintenance of effective public relations 

l. Adherence to established operating policies. 
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V. PRACTICAL SYSTEM CONCEPTS 
A. System Constraints 

Many forces are acting to prevent the ideal information 
system described earlier from achieving its potential. Among 
these are: 

1. Inadequate taxonomy of educational R and D information 

2. Lack of standards for information products 

3. Lack of an established "engineering" function in the 
educational system 

4. Existing information services and interests 

5. Unsophisticated user population 

6. Differing national and regional interests 

7. Lack of system evaluation criteria and methodology 

8. Available hardware and software 

9. Cost of development and operation 

10. Legal sanctions. 

The following discussion of these forces attempts to provide 
a rationale for the selection of practical system concepts in the 
following sections of this report: 

1. Taxonomy of Educational R and D Information . Unfortunately, 
Gagne's systematic categorization of research areas (Section 
III D) ’s not closely followed in practice, so that system 
sources, files, and indices cannot be optimally constructed 
and organized. The problem may be due to the lack of a broadly 
accepted basic theory or body of knowledge from which an order- 
ly structure can be developed. This is a problem common in 
the behavioral sciences and particularly evident in education, 
since larg^-scale R and D activity in this field is relatively 
new and since the development of a structure seems to be 
largely a function of time. 

This situation causes difficulty in the following areas 
of inform.ation system design: (1) system indexing, (2) identi- 

fication of directly applicable versus related or allied bodies 
of data, p) location of sources for such data, (4) estiniaies 
of its utility for various user groups, and (5) decisions about 
maintaining collections of specific types of data. For example. 



when someone in an elementary school district directs a 
question to the system about methods of teaching reading to 
slow leai^ners, an immediate problem arises with the selection 
of descriptors. Ke> words, such as "reading," "language," 
"instructional methods," "children," "exceptional," "retarded," 
etc., must be identified. The sources of information must 
also be located, since there might be important findings in 
the fields of medicine, psychology, anthropology, biology, 
engineering or sociology, as well as education. In addition, 
there might be organizations, ranging from the Department 
of Defense to the Boy Scouts, whose data could be useful if 
located. 

2. Standardization . Forms of educational R and D data vary 
both in the quality and kind of reporting effort (e.g., media, 
format, and comprehensiveness) and in the degree of application 
of conventional R and D evaluative criteria. The lack of 
rules in the reporting game makes evaluation of innovative 
projects extremely difficult and promotes the mechanisms of 
visitation and personal contact as necessary supplements to 
report reading. 

When a viable information system establishes an index and 
file structure, it must, to a certain extent, impose standard- 
ization on the taxonomy of educational R and D. The product 
itself does not have as great an effect on standardization, 
which is an essential requirement of the user. The informa- 
tion system must establish certain format standards for its 
output and must notify the user when the product supplied 
deviates from the standard. Of particular relevance to the 
user are such elements as stage of development of the innova- 
tion, research design adopted, evaluation methods used, and 
bibliography. 

Broader considerations of standards, such as quality of 
the R and D effort, terms and methods required for auto- 
classification of report subjects, and procedural reporting 
to central repositories, are responsibilities of the total 
educational community rather than the infonnation system. 

3. The Engineering Function . Since, in most fields, research 
results are rarely available in forms suitable for applica- 
tion, they must be modified in some way for use in a production 
process. In education, the classroom teacher is the production 
worker and the researcher is the developer. However, no for- 
mal translation function comparable to the engineering func* 
tion in science has been established. The information system, 
therefore, has no organized source of "engineering" data, 

such as comparative, evaluative and interpretive reports, 
handbooks, teachers' guides, and manuals. Since working 
level personnel require these products, the system designed 
must be responsive to their need. 
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4. Existing Information Services . It makes little sense to 
design a system without considering the capabilities of s^ist 
ing organizations concerned with information transfer. AM 
of the functions described in the section on model system ^ 
requirements are in operation today. However, in some cases 
they are not performed by the appropriate individuals or 
groups; in other cases they are not performed efficiently 
enough to satisfy user requirements. Moreover, the various 
efforts are not coordinated and made available to the user 
on a single interface point basis. 



At present, so many systems are in the operational and 
developmental stages that the Far West Laboratory must 
analyze their approaches, and procedures in order to establish 
appropriate roles in its own concept of an information system. 
Among the systems that must be considered are; 

Educational Resources Information Center (ERIC) - U. S. 

Office of Education ,mTr\ t h-* 

Educational Products Information Exchange (ERIE) - insti- 
tute for Educational Development 
School Research Information Service (SRIS) - Phi Delta 

Kappa 

State Department of Education systems m c i 

Information System for Vocational Decisions - New England 

Educational Data System (NEEDS) 

National Clearinghouse for Mental Health 

(NCMHI) - National Institute of Mental Health 
Science Information Centers Branch - National Institute 
for Child Health and Development (NICHD) 

Defense Documentation Center . ^ u • i 

Clearinghouse for Federal Scientific and Technical 

Information (CFSTI) - U. S. Department of Commerce 
National Library of Medicine 

Science Information Exchange - Smithsonian Institution 
National Referral Center for Science and Technology - 

Library of Congress , , /.,rA\ n -i- 

Data Banks - National Education Association (NEA), Project 

TALENT 

NEA research summaries ^ ^ c. 

Indexes, e.g.. National Information Center for Educational 

Media, Grant Data Quarterly, Education Index 
National, regional, and local libraries. 



An examination of the functions performed by existing 
organizations and their systems should determine whether their 
objectives and products serve the general interest of school 
personnel or are of use only to a special interest group. 
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5. Characteristics of the User Population . Some traits of 
the user population may serve as system constraints. Since R 
and D data is not a day-to-day operational need, school per- 
sonnel are generally not trained to search out or use avail- 
able information. Both the information product and the system 
itself must therefore be tailored to the needs and abilities 
of an unsophisticated user group. Moreover, school personnel 
are not problem-oriented; that is, they are not skilled in 
problem formulation, definition, or analysis and, consequently, 
do not ask the proper questions. A dialogue capability must 
therefore be included in the system to ensure that the correct 
question is asked. 

School personnel must be motivated to use information ser- 
vices now available. Improved service may require less motiva- 
tion, although the system should still include some stimulus 
capability foi promoting effective use. School personnel who 
begin to seek out R and D data have usually experienced some 
role change which places them in a new position in the innova- 
tive or change process. The system content, its media and 
format, must thus be responsive to the function and role of 
the user. 

6. National vs. Regional Interest . National, regional, 
community, and classroom goals are evident in the concerns of 
the educational community. Although it might be difficult, 
one could theoretically relate the specific behavioral objec- 
tives of a mathematics lesson unit, for example, to all of 
these goals through an "objectives tree." 

Educational R and D is funded primarily by organizations 
with national interests. To ensure proper direction of this 
funding, there must be communication between those who are 
concerned with local problems and those who influence the 
allocation of resources at the national level. 

The information system would become aware of divergent 
interests when it failed to satisfy local user requests 
because of inadequate educational R and D effort in a particu- 
lar subject area. A function of the information system, 
then, should be to effect a feedback mechanism to maintain 
communication lines between sponsors and users of educational 
R and D. The existence of disparate local and national view- 
points also implies that indexing systems must accommodate, 
through cross-indexing, widely varying subject descriptors. 

7. System Evaluation. An integral part of a well -designed 
information system is an assessment and evaluation mechanism 
for collecting information that will improve the system. 

This can be achieved by using measurable parameters to des- 
cribe the system objectives and then periodically testing 
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accomplishment through measurement and comparison with 
adopted standards. 

In the proposed system, the objectives may be expressed 
as "improve the quality of education," "improve decision making," 
"make more information available to school personnel," or 
"increase the awareness of alternatives." These are rarely 
measurable with available instruments; however, they must be 
expressed in measurable terms or system evaluation will be 
virtually impossible. 

8. Available Hardware and Software . Fairly exotic information- 
handling equipment is presently available, although its applica- 
tion to social systems has not taken place as rapidly as had 
been estimated. The applications of the more advanced hard- 
ware and software have been oriented heavily to military and 
scientific objectives because of consuming national interest 

in those areas. The usual reasons for considering the applica- 
tion of automated equipment are (1) volume of data in the sys- 
tem, (2) need to obtain information quickly, or (3) desire for 
additional processing capability. These are not presently 
critical factors in the case of educational R and D data. The 
assumption that development of data processing machinery will 
surpass central file handling requirements of the information 
system is therefore a safe one. 

In the areas of input/output (I/O) devices, however, infor- 
mation technology is deficient. The emphasis on use of key- 
board devices, with attendant training requirements, makes it 
difficult to meet user demands for "easy" access to a large 
data base. Further development with CRT/Light Pen devices 
promises relief in this area; however, the wait for natural 
language I/O units and question answering systems will be a 
long one. 

9. Cost of Development and Operation . Dollar limitations 
always operate as constraints on information system develop- 
ments. In the usual business system application, it is possible 
to identify present costs of handling data and subsequently 

to derive the dollar value of a proposed information system. 

In education, however, it is difficult enough to establish a 
need for R and D data in terms of the operation of a given 
school district, let alone to estimate either the cost of 
providing it in its basic form or the value of improving the 
system. 

One approach to the cost problem would be to assume that 
the responsibilities for total system operation will be allo- 
cated, for some time at least, to a number of different 
organizations. Each organization would undoubtedly have to 
evaluate the cost of performing given functions or running a 
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subsystem in terms of the benefits it would receive from the 
total system. 

If all of these organizations were to pool their resources 
in order to form a national network with integrated files and 
standardized procedures, they would probably encounter great 
difficulty in securing general agreement on system design. 

Altering their individual positions on that issue would 
require great sacrifice of self-interest on the part of 
many groups. 

10. Legal Constraints . The overwhelming legal problem with 
information systems Tn the field of education arises with copy- 
rights. ERIC has tried to obtain permission from major pub- 
lishers to include their works in the ERIC files. The answers 
have been emphatically no, and for good reason. ^ Why, for example, 
should McGraw-Hill provide one copy of a book with the under- 
standing that the book will be reproduced and distributed to 
hundreds of requesters who might otherwise have purchased it 
from the publisher? A great deal of discussion will focus on 
this subject before a solution is reached. Until then, however, 
system content and distribution of hard copy must take into 
account existing copyright laws. 

State or local restrictions on instructional methods or 
curriculum might impose some unusual operating constraints on 
the systeni. The details of system design can account for such 
jurisdictional problems, however. 

B. Functional Description 

This section describes alternative practical performance con- 
cepts for each of the five major system f uncti ons . It is assumed 
throughout the following section that the function of system 
management is vested, at least on the policy and control level, in 
a single group located in a single place. Although alternative 
modes of operation will be discussed, none envision diffusion of 
this group's chartered responsibility and authority. 

1 . Collection of Information 

It would appear that there are few alternatives available 
for the process of collecting information on sources. An 
initial, fairly large body of source information is almost 
immediately available from existing literature, indices, and 
abstracting services. A first step in the collection process 
should be to assign personnel to compile this material. Begin- 
ning concurrently would be the more difficult, but si so more 
vital, job of contacting research laboratories involved in 
all areas related to education. Information would be solicited 
about fields of interest, availability of completed work 
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results, current work, if releasable, and names and qualifica- 
tions of personnel available to serve as consultants or advisors. 
Similar support and cooperation would be obtained from private 
consultants and industrial, commercial, and government research 
activities. 

A slight variation in the method for obtaining such infor- 
mation would be to request assistance from some professional 
organization to perform the necessary contact and solicitation. 
This would not be practical in the long run, but might be a 
good short-term method during the initial organization of the 
system. 

TK2 tangible result of the continuing source location 
process would be a file which an investigator could use in his 
search for specific information in response to a defined need. 

The process of acquiring information in reply to a defined 
request can be handled in several ways, depending largely upon 
how the information is stored. The following is a discussion 
of possible alternatives: 

a. If all documents are stored in a common place, they 
will probably be maintained in such a space-saving form 
as microfilm or microfiche. Access to a particular docu- 
ment would involve use of a code to locate the particular 
portion of the film or fiche desired and then either visual 
examination of the document record if the requestor is scan- 
ning, or production of a photographic print if a copy is 
needed. Given suitable reproduction equipment, this pro- 
cedure could fill a well-defined request within twenty to 
thirty minutes. 

b. If ::ome or all of the documents are stored in a loca- 
tion remote from the requestor, access will require remote- 
handling methods. Delays will be introduced by the hand- 
ling process— mail , messenger service, queues at the pro- 
cessing facility, etc. Turnaround time from request to 
delivery of copies of documents can be expected to take 
from one to ten days. In many cases, delays of this length 
are not critical, since studies of curriculum material are 
essentially long-term and usually not undertaken on a "crash" 
basis. Scanning of abstracts, however, must occur on a 
"rapid turnaround" basis in order to facilitate the selec- 
tion of material for in-depth study. This means either 
that some type of "micro-reader" must be available foi use 
with a micro-form abstract file at the local system terminal 
or that a file of printed abstracts must be maintained 
there for inspection purposes. 
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c. It would seem that a local terminal equipped with micro- 
film or microfiche abstracts and a suitable number of self- 
help micro-readers of economical design would satisfy the 
scanning requirements. Some comments have been made that 
operating the viewing equipment is difficult for lay users. 
There is much evidence from experience in other fields, 
however, that if the equipment is well -designed and if 
proper training is offered, the users should have no 
difficulty. 

2. Preparation, Indexing, and Maintenance of Files 

The following alternatives might be suggested for this 
function: 

a. Preparation of documents for inclusioi'. in the system 
should cover a review of the source material to ensure that 
the necessary abstracts and interpretive summaries have 
been suitably prepared, both in form and content, to 
satisfy user requirements. If these are not available 
or readily obtainable, the preparation function should 
provide them. The following represent alternative 
preparati on acti vi ti es ; 

(1) A large, possibly national, activity could be 
organized to abstract and interpret all innovative 
material evaluated as pertinent and useful to educa- 
tion. The advantage of this central group alternative 
is its capability of serving many different educational 
disciplines, assuming the availability of qualified 
reviewers in different areas. It might also represent 
a most effective method in terms of cost. 

(2) Specialized reviewing activities, each serving 

a restricted set of disciplines, could be established, 
possibly within the framework of existing educational 
centers. Already implemented to some extent in the 
ERIC system, this review process offers a practical 
method that uses existing facilities and qualified 
personnel at locations which lend themselves to the 
specialized approach. 

(3) Preparing abstracts and interpretive summaries 
at the source of the research material would afford 
the least overall cost and seems a very sensible and 
effective long-term method. A system of rewards for 
researchers who effectively per-^orm this function 
does not presently exist. Such a system, along with 
additional training and changes in attitude toward 
end-use of research efforts, is essential to make 
this alternative practical. 



40 



b. From the user's point of view, a single, easy-to-use 
indexing scheme would be desirable. Its scope should be 
broad and flexible so that new categories may be added at 
any time. The design should permit the use of efficient 
machine search methods. Training must also be provided 

to facilitate understanding and use of the indexing scheme. 
Attention must be constantly directed to updating descrip- 
tive information as the scheme undergoes revisions. A more 
detailed discussion of alternative indexing methods is not 
considered pertinent to this study. 

c. File maintenance is, for the most part, a clerical or 
mechanical procedure dependent on the physical configura- 
tion of the files. Alternatives must therefore be deter- 
mined at the discretion of personnel in charge of file 
upkeep. Establishment of uniform maintenance procedures 
at all locations would be essential. The enforcement 

of such procedures would be an important part of the 
system management responsibility. 

3. Interface with Users of Information 



Services performed at the interface point consist large y 
of assisting the user to obtain desired information from the 
system. Provision of information about the system itself, 
assistance in formulating requests which better use the class- 
ification scheme, help in devising alternate search strategies 
and in locating other possible sources, and provision of the 
desired textual material are all general functions of the 
interface. An important qualification of the interface agent 
is a thorough knowledge of the system's operational capabilities 
and resources. He should also have some familiarity with user 
requi rements . 

The "idealized" system would be heavily hardware-oriented, 
that is, the user could address his ."equests directly to a 
computer-controlled complex of retrieval equipment and, with 
the aid of program-controlled search methods, locate the 
specific reports or portion of a report he desired. A console 
unit display or rapid printing and delivery of such information 
would provide him with the necessary data. Some retrieval 
systems now in existence perform such functions; however, these 
are extremely expensive and, at least for the present, too 
advanced for retrieval of educational R and D information. 

More practical methods of interface for the system user 
Involve either (1) personal access to records of the material 
on file or (2) access to an individual familiar with source 
material and subject matter and v^ble to assist in or perform 
the required search. The first method involves training the 
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user in details of system operation, making available copies, 
or at least abstracts, of all documents on file for him to scan, 
and providing a reproduction service to print permanent copies 
for further use. This method does not provide the user with 
much assistance in accumulating knowledge of either file con- 
tent or alternate search methods. The second method— use of 
an expert advisor as an interface agent— is generally more 
successful and probably preferable. Telephone, mail service, 
or personal contact would permit access to the advisor. One 
person in a school library, one or several in a district office, 
or many in an office serving an entire region could fill the 
role of “advisor." The functions performed would be similar, 
while the method applied would depend upon funding, anticipated 
use, and expressed interest. 

At the present time, a practical approach to interface 
might be to synthesize available alternatives— use personal 
agents to handle special questions and non-personal agents to 
process routine requests. 

Mplication of Information to Classroom Problems 

Specifying alternatives for performance of this function 
is beyond the scope of this study. Methods should be selected 
at the discretion of school administrators, curriculum developers, 
and classroom teachers themselves. As these groups progress in 
their knowledge of and experience in using the system, alter- 
natives will evolve. An alert system management activity will 
then ensure that these alternatives are documented and made 
available to all users. 

5. System Management 



The twelve sub-functions of system management already 
suggested (Section IV B) describe an "idealized" situation 
in which management exerts relatively close control or influence 
over the operation and use of the system. Cost constraints 
would modify the emphasis placed upon these sub-functions. The 
probable establishment of a trade-off system would also affect 
the sub-functions. 

Alternatives in the management function itseli would there- 
fore be derived from the various combinations of emphasis 
considered desirable. Alternatives in the forin of the manaae- 
ment would depend on such factors as location, number and type 
of interface points and document files, and degree of effort 

required to cooperate with sources of information not included 
in the system. 
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VI. ASSIGNMENT OF ROLES AND FUNCTIONS 

I u step in determining practical alternative roles for the 

aboratory within the overall information system is to assign functions 

whose present operations or developmental effort* 
meet identified system requirements. u|j||i=ni.ai erTori:. 

A* Collection of Information 

The identified sub-functions of the collection process-loca- 

acquisition— are being or will he met by 

Th^M national and local levels. 

InH Education s Division of Information Technology 

assuming the dominant national role through 
operation of the Educational Resources Information Center (ERIC). 

ERIC has established eighteen clearinghouses which receive 

subject areas, decide on their applicability 
for inclusion in the system, and perform cataloging, abstracting 
and indexing operations. The acquisition function is arranged 

other?^ thP^fnii^^-^ agreements with, among 

otners, the following sources: 

All Office of Education-administered programs (Elementary 
and Secondary Education Act Titles, etc.) 

Office of Economic. Opportunity 
National Science Foundation 

Department of Labor - Office of Manpower Policy, Evaluation, 
and Research 

Department of Defense 

National Institute of Mental Health (NIMH) 

National Institute for Child Health and Development (NICHD) 

nuhiiihplic^iliii^^^^^ underway to determine whether or not 

publishers win consent to the reproduction of selected elements 

literature which are of interest to the educational 

all objective of ERIC is to become a single source of 

will hi relevant to education. The acquisition function 

will be steadily expanded to absorb more of the non-traditional 
sources that are becoming important to the field. 

+hr> organizations performing clearinghouse functions on 
the national level include: 

National Clearinghouse for Mental Health Information, NIMH 

Defense Documentation Center 

Science Information Centers Branch, NICHD 

Clearinghouse for Federal Scientific and Technical Information 
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Science Information Exchange, Smithsonian Institution 

National Referral Center for Science and Technology, Library 
of Congress 

Human Relations Area Files, Inc. 

Neurological Information Network 

Performing acquisition functions at the subsystem level are 
the professional organizations which publish journals and sponsor 
conferences, the total library system, state departments of 
education, indexing services, and individuals who maintain large 
collections in their special field of interest. For our purposes, 
however, the "information system" function of acquisition is 
accomplished by larger entities who regard these subsystems as 
sources for the national network. 

The acquisition of local information is more difficult. The 
p*"imary objective of Phi Delta Kappa's (PDK) School Research Infor- 
mation Service is the acquisition of information about school 
projects, for which PDK intends to use its nationwide network of 
professional members. Although this effort is just beginning and 
therefore cannot be evaluated, problems encountered in organizing 
the acquisition network portend a difficult developmental period. 
State Departments of Education also have important roles in this 
function, but they are not organized specifically to process the 
acquired information for storage and dissemination. Most of the 
local information now resides within the school districts, but has 
not been written up in a form suitable for extensive distribution. 

In summary, the acquisition function is being performed on 
the national level by fairly well -organized systems which are just 
now establishing mechanisms for locating and acquiring documents. 

One weakness appears to be the evaluation process, which has been 
affected by the constraints of inadequate taxonomy and lack of 
standardization. The national systems will tend to be less selec- 
tive than they should until the quantity and quality of the infor- 
mation necessitate changes in the evaluation philosophy. 

There is a clear need to acquire information on local projects. 
Obviously, a national system is not appropriate for dealing with 
local materials which may have, at best, regional interest. It 
might be a waste of effort to develop a system which searches for 
local projects of national interest and does not duplicate ERIC's 
method of acquiring materials from ESEA-funded programs. 

One of the prime functions for such proposed services as the 
Bay Area Regional Information Center might therefore be the collec- 
tion and dissemination of local materials. The state department 
of education could also execute this function if the information 
capabilities of its various divisions could be centralized. Collec- 
tion and dissemination might also be performed by the regional 
laboratories. In any case, the function merits further study be- 
cause of its present status as an unfulfilled system requirement. 
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B. Central Processing Functions 

In most instances, the organizations, systems, and services 
described above also perform the operations necessary to classify 
and store acquired documents. The existing systems appear to be 
reasonably adequate in terms of the functional requirements of 
processing, filing, and storage. However, two areas, indexing and 
reformulation, exhibit significant weaknesses. 

1. Indexing . Evidence of the indexing problems briefly men- 
tioned in the previous section emerged during one of the Task 
Force sessions. A national network now operating through feder- 
ally funded Instructional Materials Centers (IMC) provides 
dissemination services to workers in the field of special educa- 
tion. The ERIC Clearinghouse for this field is the Council for 
Exceptional Children (CEC) which apparently has only peripheral 
contact with the IMC network, led by the University of Texas 
IMC unit. At a recent meeting, leaders in special education 
adopted a thesaurus of terms written by the Texas staff which 
was not the same as the one used by CEC. CEC decided to retain 
the ERIC terminology and thus created a situation in which 
most workers in the field, by agreement, use standard terms 
which will not be reflected in the ERIC index. The conflict 
that is certain to arise will limit ERIC's capability to 

serve this field. 

The solution to the indexing problem would require the 
establishment of a feedback and review mechanism in all national 
systems. The mechanism would periodically effect system improve- 
ments based on user experiences. ERIC personnel admit that this 
need exists, but state that, in a limited funding situation, 
paramount importance must be given to operation and expansion 
of the system as presently designed. 

2. Reformulation . The term ''reformulation" means the process 
of operating on source documents, such as research reports, to 
produce abstracts, evaluative reports, interpretive summaries, 
handbooks, and guides in order to meet the needs of school 
personnel. Whether this is a function of the system or of the 
sources, as well as where the function belongs within a system, 
are arguable issues. There is no question, however, that this 
is a mandatory product requirement for the output phase of the 
information system and that no one performs this function at 
present. 

ERIC, for example, performs the abstracting function in the 
clearinghouses. It has recognized the need fov‘ interpretive/ 
evaluative literature and requested $500,000 to fund efforts 
which meet this need. These funds, however, will not necessar- 
ily be channeled through the clearinghouses. The research arm 
of the National Education Association (NEA) has also produced 
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a few summaries. No other systematized attempts have been 
made to develop new information products. It seems clear, 
then, that the Laboratory could assume a leading role in this 
endeavor. 

C. Input/Output Functions 

The greatest breakdown in existing services occurs in the area 
of user interface functions. ERIC now states that their system 
will neither offer nor attempt to offer specialized assistance to 
school personnel. The clearinghouses will not have, to any large 
extent, a service capacity for individual requests. The input/ 
output capabilities of the catalogues, indexes, microfiche, and 
reproduced documents will constitute the ERIC interface with the 
user. A similar situation exists within other national clearing- 
houses. They plan to respond to individual requests, but cannot 
support a dialogue to clarify questions, structure responses to 
fit individual needs, or provide a feedback loop to evaluate the 
information system. 

A concentrated effort should be initiated in this interface 
area. Essentially, no ordered activity is even attempting to meet 
the functional requirements previously identified in the model. 

This does not mean that no information is reaching school personnel. 
On the contrary, too much of the wrong kind of information— news- 
letters, bulletins, journals, flyers, thick research reports, and 
many abstracts— is easily available. The principal issue is that 
an unsophisticated user with limited time cannot obtain information 
in a form suitable for resolving the kinds of prc Diems and decisions 
for change which he faces. 

Different kinds of services , rather than systems, are needed 
to make R and D information useful to a larger number of school 
people. (A service of the Community Educational Resources Unit, 
funded by a National Defense Education Act (NDEA) grant, in 
San Diego County should be studied as an example of a personalized 
type of research information service.) The provision of such 
services, particularly in the area of developing models for the 
kinds of services needed, is one of the most important information 
system requirements that the Far West Laboratory can fulfill. 

D. Role of the Far West Laboratory 

Application of system constraints to the idealized concept of 
a total educational R and D information system, as well as con- 
sideration of existing systems and services, leads to the follow- 
ing major conclusions: 

1. Organization and operation of a single system incorporating 
all sources of information and using one indexing system is 
not feasible in view of the present taxonomy of educational 
information and existing organizational interests. 
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2. Two major functions are not being serviced properly at this 
time: production of user-oriented information materials (evalu- 

ative reports, interpretive summaries, and handbooks) and input/ 
output to provide a dialogue for translating user needs into 
formalized system language on input and vice versa on output. 

The national network should consist of several large and many 
smaller systems with their own collection and indexing processes. 

In addition, a subcentral processor is needed to accomplish the 
input/output functions described in the previous sections, e.g., 
the interpretation of questions, the use of various systems to 
collect and organize reports, the evaluation and presentation of 
data in a form compatible with user needs, etc. 

A reasonable approach to the proper organization of these 
processor functions, in the light of existing user habit patterns 
and available resources, would be to assign most of them to an 
information specialist within the school system. Since there is 
presently a lack of such specialized personnel, the Laboratory 
could undertake several possible roles: (1) training cind support 

of information specialists in each school district in the region; 

(2) preparation, production, and distribution of interpretive 
summaries on subject areas of local interest in a format compatible 
with user requirements; (3) preparation of an annual review of 
educational R and D. 

1. Training of Information Specialists . In this role, the 
Laboratory would establisli a training program designed to enable 
selected school personnel to use all information sources 
(national, regional, and local) to interpret questions and pro- 
vide evaluated answers, to act as needs assessment sensors, 
and to provide information interchange on local innovations. 

The individual in the school district who most nearly pei 
forms the above functions in his existing position would be 
selected to participate in this training program. The partici- 
pant might be an assistant superintendent, a curriculum special- 
ist, a data processing coordinator, a research librarian, or in 
rural areas, a county office representative, principal, or 
teacher. This specialist must be able to bring his new know- 
ledge and capability directly into the functional operation 
of the school system without necessitating major organizational 
change. If the specialist has enough influence, he may 
recommend or even implement organizational change to facili- 
tate both innovation and the use of R and D data in the innova- 
tion process. This, of course, would meet the objective of 
Component 3 (School Arrangements) of the Laboratory's Communica- 
tion Program. The training activity would also be related 
directly to the primary mission of the Laboratory (Inservice 
Teacher Education) and would thus supply a mechanism for link- 
ing the Laboratory's primary and secondary missions. 
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The training program should incorporate the following: 

a. Summary of the state of the art of information technology 

b. Thorough introduction to present sources of information 
in educational R and D: 

(1) Who and where these sources are 

(2) What their products are 



(3) How to use the sources 

c. Analysis of these sources by area of special interest 
and their relation to sources in allied fields 

d. Study of cases illustrating how sources are employed 
to meet user needs properly and how interpretation and 
evaluation are required 



e Development of evaluation mechanisms and feedback 
loops to determine the effectiveness of the information 
supplied and the requirements for new information 

f. Recommendations for local systems to follow in improving 
the internalizing of R and D information and in facilitating 
the innovative process 

g. Summary of services which would be provided and main- 
tained by the Laboratory. 



In carrying out this role, the Laboratory will have to 
develop expertise in those subject areas it intends to teach. 

Bv virtue of the course design and instruction process, pe 
Laboratory will be establishing itself as a referral cppr, 
not unlike the National Referral Center for Science and Tpb- 
nology. That is, the Laboratory will have to become knowledge- 
able about all organizations and individuals who have specialized 
information capabilities in fields of interest in pucational 
R and D. This referral capability could be offered as a ser- 
vice of the Laboratory and is appropriate to the Laboratory s 
program functions. 



American Institutes for Research (AIR) is developing a 
series of instructional sessions for orienting users to the 
applications of modern information systems in the bpavioral 
sciences. The Laboratory could capitalize on the AIR work 
in developing its own, more specialized course. 
the training program has been developed and demonstrated at 
the Laboratory, it could be moved down to the state college 
or local school level as a regular preservice/inservice 
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training device, or, it could be moved laterally or upward as 
a logical function of some other agency of the U. S. Office of 
Education. It may be that all regional laboratories might 
adopt it as a regular function. 

2. Preparation of Interpretive Summaries . The U. S. Office 
of Education has announced its intention to allocate increased 
funds for grants and contracts which support analysis of 
research that may benefit individuals implementing changes in 
educational institutions. The NEA Division of Research has 
issued three summaries of research in given areas. Other 
attempts to meet this need are scattered and therefore 
insufficient. 

The Laboratory's function here would be primarily to 
develop a model interpretive summary which maximizes utility 
to school personnel. The development of such a model would 
require the production of several prototypes which transmit 
useful information while serving the R and D function. Design 
criteria for the sumrnari.es derived from analysis of user 
requirements include the following: 

a. Subject areas should be selected on the basis of user 
interest priorities. 

b. Information content should be organized to match the 
requirements of functions in the innovation process; that 
is, there should be appropriate packages for those in the 
search, testing, or evaluation modes. Current studies of 
change processes in education should be investigated prior 
to package design. 

c. Content should also present all important information 
elements which affect change. It should include both tech- 
nical and administrative and positive and negative elements 
of significance to school operating functions. 

d. Presentation methods (media, format, timing, etc.) must 
account for differing characteristics of the audience, which 
may be composed of teachers, school administrators, dis- 
trict technical and administrative staff, or lay public. 

e. The design should answer the user's questions in his 
own terminology and should perform the translation function 

to overcome language and information display problems inherent 
in a presentation of R and D data to non-researchers. 

f. The design should take into account expressed needs of 

the user population: time limit, attractive packaging, and 

personal interaction. The criterion of personal interaction is 
critical in establishing credibility not so much for the 
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package itself as for the procedures adopted for its use 

in the school environment. 

A collection of materials in the selected subject area should 
be started in order to prepare prototype summaries. The extent 
to which the collection grows will depend on these factors: 
policy adopted regarding the comprehensiveness of the initial 
documentation effort, maintenance and updating of such documenta- 
tion, and position of the Laboratory as an expert open to in- 
quiry on any aspect of innovation in the given area. All of 
these factors deserve careful consideration because, upon 
seeing the first prototype, users will make certain assumptions 
about Laboratory capabilities and will also develop expectations 
about future Laboratory products and services. 

Collections of reasonable size could be maintained without 
resort to mechanized handling methods. Furthermore, if produc- 
tion of these summary packages is turned over to some other 
agency (hopefully the ERIC clearinghouses), none would have 
to be retained in the Laboratory. It might prove helpful, 
however, to maintain bibliographies in machine-readable form 
which would be useful to che permanent curator of the subject 
area. 

3 . Annual Review of Educational Research and Development . A 
task which would yield a product of great value to the educa- 
tional community, and which might be appropriate for the Lab- 
oratory, is the preparation of an annual review of research 
and development in educational innovation. The specific model 
for this alternative role is the Annual Review of Information 
Science and Technology, edited by the staff of System Develop- 
ment Corporation (SDC). In the production of the SDC document, 
a review board first establishes the scope of the review, 
develops an organization to accomplish the task, and deals 
with funding issues, such as grant requests or relationships 
with publishers. SDC then selects an editor to produce as 
complete a bibliography as possible of literature published 
in the designated period. The editor gives appropriate sec- 
tions of his bibliography, as well as instructions regarding 
format, page limitation, etc., to distinguished workers in 
each field who write the chapters of the document. Their 
first drafts are then distributed to competent individuals whose 
critiques are subsequently returned to the writers for incor- 
poration into the final text. The editor organizes the 
finalized material and handles coordination with the publisher 
to produce the completed document. 

The SEC example clearly illustrates how such a task can 
be organized and accomplished. Although the actual staff 
requirements for this undertaking are small, the need for 
extensive and efficient coordination is paramount. The Lab- 
oratory is well -organized and well -situated enough in the 
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educational comnunity to assume such a task and might, as a 
result, become pre-eminent in the following areas: 

a. Knowledge of progress in educational research and 
development. Although a good document would certainly 
advance the overall position of the Laboratory, the 
risk and the impact of producing a less than competent 
review should be considered. 

b. Knowledge of the relative value o*^ innovations, the 
validity of current work, and the direction of future 
efforts. Such knowledge would be valuable in shaping 
other elements of the Laboratory's progranjs. 

Moreover, the construction and maintenance of a bibliography 
on the fields or subjects chosen for review might yield a 
separate product (as SDC found) of publishable quality. 

A definitive review would be a basic reference tool for 
the researcher and the innovator. It would also foster new 
projects with improved ;ocus and more narrowly defined objec- 
tives. For more” conservative school personnel, the document 
would serve both the general and focused search functions by 
providing evaluative information in several subject areas of 
direct interest. 
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system— teachers and curriculum specialists— have 
emphasized the need for in-district assistance in 
interpreting information. Component 3 is clearly 
this need. 



consistently 
obtaining and 
responsive to 



The Task Force recommends that the emphasis of this component 
be directed toward the service described 

ing information specialists). We believe ^ 

of such specialists in districts would have a seeding effect, 
i.e., it would create an obvious need for a 
system to support instructional innovation, 
would serve both as an. information resource 
component of that lcci.1 information system. 



local information 
The specialist 
and as a basic 



o 

ERIC 
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VII. SUMMARY 

The Task Force on information system design requirements believes 
that the alternative courses of action it has proposed for the Far West 
Laboratory are consistent with the description of the Communication 
Program in the 1967 Annual Report. This belief is supported by testi- 
mony from researchers, school administrators, teachers, federal, state 
and county staff members, and its own consultants. 

A. Component 1 



Component 1 of the Laboratory's Communication Program proposes 
to use general communications media to develop an awareness, among 
the educational community and the public, of opportunities avail- 
able for instructional improvements. The Task Force found ample 
evidence that willingness to critically evaluate present and alter- 
native practices is crucial to meaningful improvement of instruc- 
tional procedures in the public schools. 

The means and media to create such a climate, however, are not 
easily discernible. Whether meetings, direct mail, television 
broadcasts, or other media are most effective should be carefully 
evaluated before substantial resources are committed to .Component 1. 
In general, we suggest that the highest credibility will go to 
media which can be adapted to the widely varying interests and roles 
of those groups which should be receptive to educational innovation. 

B. Component 2 

Component 2 is concerned with the design, development, field 
testing, and implementation of a system for production, storage, 
retrieval, and distribution of educational information. Recomnend- 
ations 2 (interpretive summaries) and 3 (annual review of educational 
research and development) of the Task Force are consistent with this 
component. Evidence from a variety of sources revealed to the Task 
Force that the lack of interpretive and evaluative summaries is the 
greatest single impediment to teachers' use of R and D information. 
Although all segments of the educational community deplore this 
inadequacy, no one is prepared or plans to satisfy the need in any 
systematic manner. We believe strongly, therefore, that the Labor- 
atory's development of a model for the preparation, production, 
and distribution of evaluative and interpretive summaries, as well 
as the preparation of critical reviews, will be major contributions 
to the effective functioning of the information system serving pub- 
lic education. 

C. Component 3 

The third component seeks to develop and evaluate arrangements 
within schools that will facilitate the use of educational R and D 
information. The chief users of the educational information 
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svstem— teachers and cumculum specialists— have 

imnhLized the need for in-district assistance in obtaining and 

fSpreting infomation. Component 3 is clearly responsive to 

this need. 

The Task Force recommends that the emphasis of this component 
be d reeled toward the service described in Alternative 1 {train- 
ing llforSation Specialists). We believe that the avail abim^ 
nf ciirh soecialists in districts would have a seeding effect, 
i.e., it would create an obvious need for a 
system to support instructional innovation. The 
would serve both as an. information resource and as a basic 
component of that local information system. 
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APPENDIX 

I. Work Session on User Requirements - July 27, 28, 29 

A. Agenda . Three items were considered in testimony and discus- 
sion on this topic; 

1. Present information needed about educational R and D pro- 
jects; search strategies used to obtain information; decision- 
making processes followed in the utilization of information 

by teachers, principals, curriculum and research specialists, 
district administrators, school boards, and lay citizens. 

2. Differences in user requirements due to such factors as 
grade level, types of students, school environment, and the 
size, location, and wealth of the district. 

3. Potential requirements of individuals listed under 1 

above in terms of the following questions: What kinds of 

information are needed? What kinds of format are required? 

Who needs the information? How much information is needed 
and how quickly? Where and how will it be used? What will 
be the short- and long-term effects of supplying the informa- 
tion? 

B. Participants . 

1. Far West Laboratory: 

John Hemphill, Director 
George Rusteika, Deputy Director 
Paul Hood, Program Director 
David Carlisle, Program Associate 

2. Conference Consultants: 

Robert Coney, Alameda County Schools 
Marvin Hockabout, Alameda Unified School District 
Vern Plaskett, Lockheed Missiles and Space Company 
Robert Roggenbuck, U.R.S. Corporation 

3. Session Consultants: 

Virgil Blanke, Ohio State University 
Wayne Otto, Research and Development Center, University 
of Wisconsin 

Richard Schmuck, CASEA 



54 



4, Participants; 

Roy Archibald^ National Education Association 
Ernest Aveliars Hayward Unified School Distr'ct 
Alden Badal, Director of Research^ Oakland Unified School 
District 

Edward Bispo, California State Department of Education, 

Office of Compensatory Education 

James Butler, Executive Secretary, Nevada State Education 
Association 

Roger Chapman, Director, San Mateo Educational Supplemen- 
tary Center 

Maury Chorness, Stanford Research Institute 
John Church, California State Department of Education, 
Curriculum Development 

Edwin Coffin, Superintendent of Schools, Monterey County 
Richard Conniff, Superintendent, Alum Rock Union Elemen- 
tary District 

Alvin Cressman, Calfiornia State Department of Education, 
Systems and Data Processing 

Joseph Hill, Curriculum Coordinator, San Francisco Unified 
School District 

Tamar Hoi pin, Oakland City Unified School District 
Donald Johnson, California State Department of Education, 
Program Planning and Development, ESEA 

Russell Kent, Superintendent of Schools, San Mateo County 
Alexander Law, California State Department of Education, 
Office of Compensatory Education 

Pauline Levie, San Francisco Unified School District 
Edmund Lewis, Executive Secretary, California School Board 
Association 

William Merz, Clark County School District, Research and 
Project Design 

Renato Nicolai, South San Francisco Unified School District 
Berney O'Haire, Napa Valley Unified School District 
Leo Palmiter, Assistant Superintendent, Sacramento County 
J. Win Payne, Superintendent, Napa Valley Unified School 
District 

Carl Rittenhouse, Stanford Research Institute 
James Smith, San Juan Unified School District, Reimburs- 
able Programs 

Wayne Sorenson, Hayward Unified School District, Educa- 
tional Research and Development 

Ray Sweigert, California State Department of Education 
Malcolm Taylor, Sequoia Union High School District 
Mary Tsukanato, Elk Grove Unified School District 
Glenna Violette, Sequoia Union High School District 
Betty Ward, Monterey County Schools 
Hal Weatherby, California Teachers Association, Research 
Department 

Ursula Westcamp, Folsom-Cordova Joint Unified School District 
Jerry Witt, Alum Rock Union Elementary School District 
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II. Work Session on the Content, Organization, and Location of Infor- 
mation - August 15, 16, 17 

A. Agenda . Presentations and discussion were organized around 
three questions: 

1. What types of information can be obtained from such sources 
as research reports, curriculum libraries, abstracts, indexes, 
workshops, professional organizations, etc.? How often are 
these sources used? Are there other possible sources? 

.?. How is the information organized and what search strate- 
gies are being employed? What information can be found easily 
and what cannot? What is being done about indexing, evalua- 
tion, quality control, translation, interpretation, format, 
and simplification of the information? 

3. How can the present situation be improved? 

B. Participants . 

1. Far West Laboratory: 

Paul Hood, Program Director, Communications Program 
David Carlisle, Program Associate, Communications Program 

2. Conference Consultants: 

Robert Coney, Alameda County Schools 

Vern Plaskett, Lockheed Missiles and Space Company 

Robert Roggenbuck, U.R.S. Corporation 

3. Session Consultants: 

William Gephart, Phi Delta Kappa 

Robert Gagne, University of California, Berkeley, School 
of Education 

John Loughary, University of Oregon, School of Education 

4. Participants: 

Frank Burke, Stanislaus County Schools 
Maury Chorness, Stanford Research Institute 
Edwin Coffin, Superintendent of Schools, Monterey County 
John M. Davidson, Davidson Films 

Rosemary Glenn, Contra Costa County Supplementary Educa- 
tion Center 

Urania Gluesing, San Francisco State College 

Harold Gluth, Stanislaus County Schools 

Margaret B. Johnson, University of California, Berkeley 

Richard Lewis, San Jose State College 
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Glenn McMurry^ University of Southern California, Depart" 
ment of Institutional Technology 

Charles 0, Moody, California State Department of Education, 
Bureau of Elementary and Secondary Education 
Mary Jane Parker, Stanford Research Institute 
Ann Protopopoff, California Teachers Association 
David Rawnsley, San Mateo Supplementary Education Center 
Carl Rittenhousp, Stanford Research Institute 
Mimi Sayer, San Francisco State College 
Carl Stutzman, California State Department of Education, 
Office of Compensatory Education 

Ray Swetgert, California State Department of Education, 
Program Planning, Title III, ESEA 
Beatrice Ward, Project EDINN 

Robert Weisgerber, American Institutes for Research 
Alan Wolstencroft, San Francisco State College 



III. Work Session on Information Systems and Technology - August 22, 

23 , 24 

A. Agenda . Given data obtained from sessions on user require- 
ments and sources of information, this session examined and recom- 
mended possible systems for development by Laboratory staff. Poss- 
ible processes for such items as acquisition, indexing, abstract- 
ing, retrieval , and present and future technology were described 

in terms of their advantages and disadvantages and approximate 
cost. 

B. Participants . 

1. Far West Laboratory: 

Paul Hood, Program Director, Communications Program 
David Carlisle, Program Associate, Communications Program 

2. Conference Consultants: 

Robert Coney, Alameda County Schools 

Vern Plaskett, Lockheed Missiles and Space Company 

Robert Roggenbuck, U.R.S. Corporation 

3. Session Consultants: 

Robert Hayes, UCLA, School of Library Science 
Harold Borko, System Development Corporation 
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4. Participants: 

David Rawnsley, San Mateo County Supplementary Education 
Center 

Carl Rittenhouse, Stanford Research Institute 
Ray Sweigert, California State Department of Education, 
Program Planning, Title III, ESEA 



IV. Recap Session on User Requirements 

A. Agenda . Participants conducted a reexamination of information 
gathered at the first work session on this topic. 

B. Participants . 

1. Far West Laboratory: 

Paul Hood, Program Director, Communications Program 
David Carlisle, Program Associate, Comnjuni cations Program 

2. Conference Consultants: 

Robert Coney, Alameda County Schools 

Vern Plaskett, Lockheed Missiles and Space Company 

Robert Roggenbuck, U.R.S. Corporation 

3. Participants: 

Lily Lahti, Coordinator, Instructional Materials, Acalanes 
Unified School District 

Peter Lamb, Director, Secondary Instruction, San Lorenzo 
Unified School District 

Ronald Leppke, Guidance Consultant, San Ramon Unified 
School District 

Albert Mayrhofer, Coordinator, Instructional Materials, 

San Mateo Unified School District 

Allan Petersdorf , Director, Elementary Instruction, Hay- 
ward Unified School District 

Donald Russell, Director, Elementary Curriculum, Mount 
Diablo Unified School District 



V. Work Session on National, Regional, State and County Roles and 
Relationships - August 28, 29 

A. Agenda . After a review of the three previous sessions, con- 
sideration was given to dissemination efforts not only of the 
organizations represented at the hearings, but also of the follow- 
ing agencies: 
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1. Other U. S. or State Department educational agencies 

2. Other U. S. agencies, such as OEO, Job Corps 

3. Private foundations 

4. Colleges and universities 

5. Military and industrial educational systems 

6. Para-educational agencies 

7. Other educational associations. 

In addition to ERIC and SRIS, other planned or operating national 
infcrmation services were discussed in terms of the following 
questions: 

1. What are they? 

2. What are they doing or planning to do? 

3. What are possible areas of cooperation between the Labora- 
tory's system and these networks? 

B. Participants . 

1. Far West Laboratory: 

Paul Hood, Program Director, Communications Program 
David Carlisle, Program Associate, Communications Program 

2. Conference Consultants: 

Robert Coney, Alameda County Schools 

Vern Plaskett, Lockheed Missiles and Space Company 

Robert Roggenbuck, U.R.S. Corporation 

3. Participants: 

Kenneth Brown, California Teachers Association, Office of 

Instructional Services , ^. . . 

Lee G. Burchinal, U. S. Office of Education, Division of 

Research, Training and Dissemination ^ ^ ^ 

John Church, California State Department of Education, Divi- 
sion of Instruction 

Rosemary Glenn, Contra Costa County Supplementary Education 
Csntsr 

Glenn Hoffman, California School Board Association 
James P. Kiley, Nevada State Department of Education, Instruc- 
tion Division 
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Donald Mahler;, California State Department of Education, 
Bureau of Educationally Handicapped and Mentally Exceptional 
Children 

Mrs. Chase McJunkins, California State Department of 
Education, Title I, Office of Compensatory Education 

Charles 0, Moody, California State Department of Education, 
Bureau of Elementary and Secondary Education 

David Rawnsley, San Mateo County Supplementary Education 
Center 

Carl Rittenhouse, Stanford Research Institute 
Myron Schussman, San Mateo County Schools Office 
Carl Stutzman, California State Department of Education, 
Office of Compensatory Education 

Ray Sweigert, California State Department of Education, 
Title III, Division of Instruction 



